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Maxis 


, SimCity, SIMS, <cough>Sims Online<cough> 
¢ Ongoing trend: player-originated content 


— Started with mods, new textures, BAT 


— Went to another level with Sims: houses, objects, 
story-telling, extensive sim modification 


— Continued with Sims 2: see 
http://thesims2.ea.com/exchange/ 


¢ Encouraging player content a big deal for us 
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Spore 


Elevator pitch 
— Play from a cell to a galaxy-spanning civilization 


But, behind-the-scenes agenda: 

Take player-created content to the next level 
— Assume that everything is generated/modifiable 
Build content-sharing in to the game 

— So you are automatically playing with other player’s 


content 
SPORE 





MMOs 


Massively Multiplayer Online Game 
Persistent World 
Broadcast avatar location and world state 


Hundreds or thousands of players 
simultaneously 





MSO 


Massively Single-player Online Game 
Substitute game world with Content 
Players create parts of their own world 
Content is pollinated to/from other players 


— You create your own avatar and associated assets, 


everything else is from other players 


— For non-network play, ship with a set of Maxis 
assets 


Content from tens of thousands of players 
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Spore: Player-Created Stuff 


¢ Want players to be able to create key parts of 
their game 


¢ Pollinate player-created things via servers, so 
your game is made of both your own 
creations and others: 


e Richer experience, less art work(!) 





Spore 


¢ Creatures, Buildings, Vehicles... 
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Player-Created Stuff: Creatures 





Player-Created Stuff: Buildings 





Player-Created Stuff: Cars 
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Player-Created Stuff: Boats 
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Player-Created Stuff: Planes 








Player-Created Stuff: Hybrids 











Why not MMO too? 


¢ Game is single-player: reduce Fisk (rotiow iaugn) 


° Goals 
— Story-telling 
— Richer World 
— Sense of scale 


¢ Didn't need multiplayer support to achieve 


this 
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Spore Development 


<mumble> - 2005: concept development 
GDC 2005, initial announcement, showed 
prototype with pieces knitted together in Sims 
2 engine. 

June 2005, started on Spore engine & 
associated games 

Shipping some time in 2008 





Technology 


Player Model Creation 
Player Model Texturing 


Animation: procedural, deformation, runtime, 
skeleton re-targeting... 


Procedural Planet generation 
spherical Planets 

Editor Interaction 

Procedural & Player-generated Audio 





Technology 


Pollination: aesthetic matching, queries, tags 


Five individual games: 

— pathing, collision detection, procedural level layout... 
Galaxy representation 

Engine stuff: lighting, effects system,.material 
system, resource control, job manager, ... 
Steganography (MiP: Model-in-Picture) 
Debug web server 





Technology: Today 


Player Model Creation 
Player Model Texturing 


Animation: procedural, deformation, runtime, 
skeleton re-targeting... 


Procedural Planet Generation 





Rigblocks: 
Detitaanil SPORE 


Objects 





Lydia Choy, Ryan Ingram, Ocean Quigley, 
Brian Sharp, Andrew Willmott 


How can players create models? 


e Let player use supplied parts to build model 
— Allow stacking, pinning, sliding 


¢ But, static is boring, requires many blocks to 
be expressive. So 
— Add animations that deform blocks 
— Animations driven by player-controlled handles 


¢ Result: Rigblocks, our LEGO¢myry (R\whateve—, eae 





Advantages 


e Player interaction with the block Is intuitive 
and straightforward 


¢ Rigblock deformations are expressive 


¢ Provides a balance between enabling player 
creativity and amplifying player creativity 





Advantages 


¢ Aiming for the sweet spot between: 


— High-quality, artist-created models, with no player 
control 


— Lower-quality, effort-intensive, wholly player-driven 
approach, such as providing a sculpting tool. 



































Animation Deforms Mesh 





Animation Deforms Mesh 





Creature Bodies 


Base block is a special block: body mesh 


Allow player control over a basic skeleton 
— Adjust spline, glue limbs 


Mesh generated via metaballs 


Rigblocks attached to body 





Storyboarding 
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Storyboarding 
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Storyboarding: A Single Block 








Pipeline 


¢ Standard workflow: separate author file per 
animation 


¢ Rigblocks: Multiple animations, so use track 
editor 


¢ MEL scripts control addition of handle rigs 
— Handles drive animation! (Via expressions) 


— Artist places handle, so can iterate in-Maya SPeRE 





Animation Technology 


Cant use standard animation blending 
90% Def A+ 50% Def_B != Average(A, B) 


Use cumulative blending from rest pose 


— Match Maya by composing deform matrix at end 
from separately accumulate scale, rotate, translate 


Multiblender 


— Handles standard “runtime” animations 
— Applies deforms on top 





Baking 


¢ Remove all deform animations, producing a 
new base mesh 


¢ Model must be able to be rendered at game 
rates 
— Single texture page, single material 
— Generate LODs 





Baking: Animation 


¢ Desirable for blocks. to carry “runtime” 
animations through (e.g. mouths) 


¢ But such rigblocks must be substituted with 
low-bone-count versions 


¢ Requires retargetting composite deform pose 
to new runtime skeleton (base pose has 


changed) speac 








Authored Block Be oA 


DONE GonzagoSystem - PostModeTransition [Debug 1] 





Runtime Animation 





- Many bones - Reduced skeleton 
- Skeletal animation - Skeletal animation 


- Blendshape animation SHBO@RE 





Runtime Animation 


DONE GonzagoSystem - PostModeTransition [Debug] 





- Apply deformation handle - Mesh is retargeted to new 
(runtime) skeleton 





Runtime Animation 
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Animation 


Kees van Prooijen, Chris Hecker, Jordan 
Maynard, Ryan Enslow, Bernd Raabe; John 
DeWeese 


John Cimino, Tony Gialdini, Bob King, Gal Roth 


Creature Animation 


¢ Standard art pipeline: 
— Modeller makes the asset, with a given skeleton 
— TD sets up a ‘rig’ for that skeleton 
— Animator drives that rig to create animation clips 
e Spore: 
— PLAYER makes the model, arbitrary skeleton 
—??? 
— Animator has to animate ... what? 
¢ Profit! 
SPORE 








Starting Point 


Creatures are: a spine, with attached limbs, 
and rigblocks (parts) 


Tree structure 
Know what endpoints are 
Know limbs vs. backbone 


Can attach properties to rigblocks 
— mouth, foot, weapon 





Underneath the Skin 





History 


¢ Originally: 
— Identified feet/graspers 
— Used (programmer-written) Lua rules to drive them 


e Mixed Results 
— Feet worked pretty well 
— Poor quality 
— No way to get an animator in the loop 





Havok 


Want to abstract animation 

— Just act on those things we know about 

— “Fill in” other bones somehow 

So, run rigid-body physics on skeleton 
— Gives roughly plausible motion 

Add contraints for end effectors 


Good initial results 


— Just driving feet gave natural motion, nice 
secondary effects 





Feet 


Started off as simple phase function in time 
and WN feet 

By tweaking the function, can get different 
looks: walk, run, sidle 

Current version also drives foot “look” 

— Toe curl (rigblock animation), ankle joint 

Many, many other improvements -- four years 
of development 





Animator Friendliness 


The more familiar we can make the process 
of animation creation, the better the results 


Good animators are an invaluable resource 
Animators used to keyframing skeletons 


Need to abstract again: 
— Replace specific bones with selection queries 
— Animation is not absolute: relative to a frame 


Rest is quite familiar 





Selection 


° Small, simple matching grammar 
¢ Allows animator to select parts to operate on 


e Need to handle zero or N matches 





€3, Smart Playlist 


Iv Match jal +| of the following conditions: 
lA Artist +| [contains +| They Might Be Giants | + 
[Yea +| fis less than +| [2000 -| + 
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Frames 


Even with selection, need some context 


Move <grasper> to same creature's <mouth> 
Move <grasper> to other creature's <grasper> 
Move <mouth> to <target> 

Move <weapon> to ground-relative <target> 


Animations keyed with respect to frame 





Havok? 


¢ Worked well for exploration 
— helped us clarify what we needed the system to do 
¢ However, had poseability problems 


— Animator could set up a pose that the creature had 
problems reaching 


— The more complicated (and thus constrained) the 
animation, the worse the behaviour 


— Needed to re-think approach or face uncomfortable 
limits on artist creativity 





Havok Replacement 


Forget physics + constraints, too sloppy: use 
direct IK 


Wrote our own specialized IK solver 
Several iterations to get right 
Final one that worked: particle-based.IK 


Plus, lots of semantic info, special cases, 
tweaking 
Simplicity of particle approach lends itself to 


this SPORE 





Secondary Motion 


¢ Problem: lost all our secondary motion! No 
more swaying, natural follow-along 
movement 

e Layered new system on top to re-inject this: 
Wiggles 

¢ Finds bodies that arent driven directly, and 
uses spring mass system to add secondary 
movement 





Part Animation 


50-90% of creature Is parts, not interior 
skeleton 

Rigblocks have runtime animations 
Procedural animation system can trigger (or 
scrub) these 

— Open/close mouth animation 

— Graspers open/close/point 

Also: trigger effects on bones 





Remaining Problems 


e Iteration, Iteration, Iteration.... 
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Remaining Problems 


e Iteration, Iteration, Iteration.... 
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Iteration 


¢ Tight loop between animators and animation 
engineers 
— Finding problematic situations 
— Fixing by adding new context queries, adding 
additional IK features 
¢ Very common in game development 
— Keeping iteration overhead low Is crucial 
— Hence custom anim tool: Spasm 
— Fast startup, animators/engineers work in same app 





Player-Driven 
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Texturing 





Henry Goffin, Grue, Chris Hecker, 
Ocean Quigley, Shalin Shodhan, 
Andrew Willmott 


Problem Area 


° We let players create their own creatures, 
huts, buildings, cars, boats, planes... 


¢ How do we texture them? 


¢ Once we're done, how do we turn this into a 
game model? 





Previous Work 


SSX 


— Swap in different player meshes, accessories 


sims 2 Bodyshop 
— Facial morphs 
— Select clothing: top and bottom texture pages 


Need for Speed vehicles 
— Decals, morphs on many parts 


Many more 





Previous Work 











Previous Work 


e0aF @ The Sims 2 Body Shop 


QT Beene rors) 





Texturing: Player Control 
¢ Want satisfying player input 


e Not too detailed 


— Too tedious for the majority 


¢ Not too simplistic 
— Everyone's model looks the same 


— Want to go beyond overall texture layer selection 





Two Solutions 


¢ 1. Creature Texturing 
— Full brush-driven 3D texture painting 


— Driven by our effects system rather than a human 


— Variety by layering different parameterised scripts 
— Organic look 


e 2. “Mineral” Texturing 
— Repeating textures 
— Paint regions 
— Procedural UV'ing 
— Buildings, Vehicles, UFOs 





1: Skinpaint 


¢ Brushes: diffuse, spec, aloha, bump map 
— Mesh is uv mapped, for any point on mesh, brush 
can be splatted into destination texture 


¢ Brush selection and position controlled by 
effect system 


— “Particles” can be moved over surface using frame 
adjustment, affected by skeleton 


— Library of effect scripts 





Skinpaint: Early Prototype 





Skinpaint 
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2: Procedural UV’ing 


Model parts deform (Rigblocks) 
Model parts tagged with regions 

— Use for material and functional areas too 
Regions tagged with uving type 

— Boxmap 

— Cylinder, sphere, planar, disc 


Applied in Vertex Shader 


Textures parameterized by two COIOUrSs a @ pe 
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Paint & Proc UV Demo 


Demo 





Player-Created Models In-Game 





Problems! 


¢ Player-created model is not suitable for game 
USE 
— Too many meshes (can be many parts) 
— Too many materials and textures 
(Parts x regions = a lot of batches) 
— Efficient rendering on GPU requires minimizing 
batch count. 


— No LOD! 





Solutions 





le 
e Two solutions: 
— Texture Splatter 
— Mini Geometry Pipeline \ 





Texture Splatter 


° Generate unique UVs for ‘editor’ model as 
second uv set. 


e Render model with clipPosition = float4(uv2, 0, 1) 
— Splats source textures into a single texture sheet 


— Allows resampling of high-res editor textures into.a 
Known-size texture, constant for all models 


— Old trick from Sims 2 neighbourhood lots 





Unique UVs: Charting 


¢ Use face clustering to generate charts quickly 
— Generates ‘flattish’ chunks of geometry for charting 


¢ Optionally run LSCM relaxation on these, 
otherwise planar project 


e Use horizon-map-style packer (similar to 
Levy et al.) 





Ambient Occlusion! 


¢ Problem with approaches that dont involve 
an entire-skin texture: no dark map 


e We generate as a post-pass using GPU 
(accumulate shadow passes for model) 


e Visual glue that holds everything together 





Splatter + AO + Chart 





DXT 


¢ Standard DXT Compression is unusably slow 
— Brute force search for best two colours in 4x4 block 


e Two ‘fast variants: id, internal EADXT lib 


— Both basically skip the search 


— Resulting colour blockiness too objectionable 
(downsampled version looks better) 


— Went with compromise: sample small number of 
points in search space and find best 


— Eliminated blockiness, 20ms on average machine 


for 512x512 
SPORE 





Geometry Pipeline 


¢ Can now weld all meshes together 


¢ Generate LODs by Vertex Decimation 
— Faster than edge-based simplification: single pass 
—< 100 ms for 4 LODs, 50,000 vertices 

° Has to handle vertex element discontinuities 
— Due to uvs, normals, tangents, bone weights 
— Must minimize discontinuities in output 


— While removing degenerate triangles, build chains of 
“shareable” vertices 


— Single-edge degenerate tris are key SPORE 





Geometry Pipeline 


¢e LOD Generation uses per-type LOD control 
settings: 
— Set simplification factor 
— Strip tangent space data 
— Force one weight per bone 


— Force the mesh to be static (i.e., strip all animation 
data) 


— Force mesh to share all vertices 
— DXT compression settings 





Baking Details 


¢ Desirable that we can do this while game is 
running 
— No blocking! 


e Various chunks written:as background jobs, 
controlled by job manager 
— Background load all source assets 
— Bake, then cache results to disk 
— Graphics assets need to be created in main thread 





ana Worlds SPORE 





James Grieve, David Lee Swenson, Andrew 
Willmott, Henry Goffin 


Kate Compton, Ocean Quigley, Christian 
Stratton 


Alumni: Ed Goldman, Eric Todd 


Background 


¢ Spore based on “powers of 10° 
— Cell life (2D world) 
— Planet: creatures, tribes, civilisations 
— Solar System 
— Interstellar 
— Galaxy 


e Want seamless transitions 
planets need to be spherical 





Planet Constraints 


Need to have lots (millions? billions? ) 
— many more than we can manually author 
Need to be playable 

Must look good 

Need to be fast to generate 

—We cant store all these planets 

— Would like to transmit them at some point 
Need to support terraforming 

— Player modification of planet to support life 





Areas of Interest 


Parameterization 


— How do we store planet representation over 
surface? How do we store game data? 


Generating Heightfields 

— What are the operations? How can we make it fast? 
Texturing 

— Must be heighttield driven 

Authoring 


— Variety, art control 





Parameterization 


¢ Possible approaches: 
— Longitude/latitude (pole cap) 
— Gnomic 
— Freeform 3D: Sparse Voxel 
— Charts 


e Regular: cubemap, diamond, duodecahedron ... 
e On-the-fly (Voronoi-style) 

e Orthographic projection 

e Perspective projection 





Parameterization Goals 


Minimize distortion and discontinuities 
Efficient (heightfield) storage 
Fast mapping from (x,y,z) to (u,v) and back 


Wrapping between charts 
Rectangular area splatting 
Efficient normal map generation 





Parameterization: Cube Maps 


¢ Chose cube maps. as the best compromise 





Parameterization: Cube Maps 


Chose cube maps as the best compromise 
Faces are grids 

— Familiar from previous games 

Distortion at corners 

— But not too bad, much better than pole distortion 
Face wrapping is tractable 

— Pick right face mappings -> simple permutation rules 
Projective projection 

— Lines map to great circles on sphere: very “SE eRe 





Colour Map 





Normal Map 





Normal Map 


¢ Derived from height.map 
— Large source of CPU time early on 
¢ Standard DDF to find ‘flat’ normal map 


— Can then use Jacobian to warp to spherical form 


h/w(1 — s?/w?) —sth/w? —sh/w 
HN. (0) = | —sth/w> Doll =p) ala awe 
s/w t/w 1/w 


w = f(s? +4741) 





Generating Height Fields 


Brush system that operates on the sphere 


Brushes are 2D textured rects 


& bi 2% 


Several different brush i 
— Conditionally raise or lower terrain 





Applied on GPU, after clipping brush footprint 


to faces 





Controlling Terrain Brushes 


e Use our effects system, Swarm, to run 
brushes over the surface 


¢ Controlled by: 
— Particle systems (spawning other particle systems) 
— Randomized parameter ranges, random walks 
— Terrain forces 
— Force/control operates in the tangent plane 





Texturing 


¢ Derive Control Map from height field 
— Filter: water level, gradient, curvature 
— Combine according to tech artist formula 


e Blends source textures to form base colour 
— Blends detail maps on the fly 


e Planets have type, atmosphere, temperature 
— Control colour ramps, and atmosphere/fogging 








Color Ramp 





Base Texture 

is blended with 

Detail Textures 

(colorized and controlled 
by ranges) 






Color ramp tinted map 
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pack into RGB 





Terraforming 





Authoring 
° Concept Sketches 





























PLAYABLE: Yes 


TAXONOMY CATAGORY: Storybook 














Based on the floor of an ancient forest, 
[nis planet has landtorms that appear 
to be ginat roots covered in Moss ana 
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Various fungii ok Ing rocks. 


PARTICLE EFFECTS 














SCRI PT TO GO UNDER 


MASSIVE OBJECT 


LAND SCRIPT 


POND SCRIPT 


LIVILLES TOR VIEW 





SCRIPT & DECAL 
GOES UNDER CLAW 


PLAYABLE: Yes 
TAXONOMY CATAGORY: Storybook 


Inspired by crab shells, this planets is made 
mostly of small strips of land that randomly 
connect to each other and to a main section 
where there is more room for cities. 
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PLAYABLE: Yes 
TAXONOMY CATAGORY: Storybook 
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moss scattered randomly near 
base of big rocks 


Authoring 


Originally one mega effects script 
—random selection between various child effects 
Difficult to control 

— Hard to get art-directed 

Introduced a top layer with more control: 
terrain scripts 

Each script produces a particular kind of 
planet 





The Result 





Authoring: Planet Editor 


Demo 








Summary 


¢ Do for content what. MMO’s have been doing 
for gameplay 

¢ Lot of tech! 

¢ High-risk 

¢ Pre-pro helped reduce risk, but still alot 
during production 

¢ But we hope it’s worth it 





Questions? 





